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STUDY  CF  SCORE  DISTRIBUTIONS  FOR 
ARMY  CLERICAL  SPEED  TEST  IN  REVISED  FORMAT 


\  BACKGROUND 

% 

The  Army  Clerical  Speed.  Test  of  the  Army  Classification  Battery  was 
revised  in  the  spring  of  1966  to  make  it  scorable  on  the  Digitek  Optical 
Scanner.^  In  the  revised  forms,  called  ACS-5A  and  ACS-6A,  the  response 
format  of  the  Number  Reversal  part  of  the  test  (Part  I)  was  changed  by 
making  the  response  boxes  vertical  instead  of  horizontal;  to  record  his 
response,  the  individual  makes  a  vertical  line  in  the  new  form  rather 
than  a  horizontal  line  as  in  the  original  format.  The  items  remained 
identical,  and  the  sequence  remained  unaltered.  Since  the  test  is 
highly  speeded,  there  was  a  question  whether  the  mechanics  of  respond¬ 
ing  would  affect  the  scores.  ^  .  r" 

The  Coding  part  of  the  test  (Part  II)  remained  unchanged  except  for 
a  rearrangement  of  the  items.  Since  the  coding  items  do  not  differ  in 
difficulty,  ho  change  in  the  scores  was  expected  and  any  changes  of 
scores  in  the  Coding  part  can  be  used  as  a  base  to  interpret  changes  in 
the  Number  Reversal  part. 

Another  change  in  the  revised  format  was  to  add  a  third  sheet  of 
instructions.  In  taking  the  test,  examinees  must  turn  the  booklet 
several  times.  In  the  previous  form,  the  instructions  for  both  parts 
were  on  a  single  sheet,  and  following  the  directions  was  relatively 
simple.  With  the  addition  of  the  third  sheet,  sane  confusion  in  follow¬ 
ing  the  directions  may  have  been  created  for  sane  examinees ,  with 
possible  adverse  effect  on  the  scores. 

Rather  than  relying  on  a  single  test  otf  significance  to  determine 
whether  the  score  distributions  for  the  two  forms  are  comparable,  the 
results  for  several  samples  will  be  examined  for  consistency.  If  the 
new  form  is  consistently  different  from  the  old  one,  then  restrandardiza- 
tion  is  warranted;  if  no  consistent  pattern  of  differences  is  observed 
and  the  overall  means  and  sigmas  are  similar,  then  the  existing  norms 
will  be  used  for  the  new  forms. 


^The  commercial  term  is  given  only  for  precision  in  stating  the  problem. 
Use  of  the  trade  name  does  not  constitute  Indorsement  by  the  Army  or 
by  BESRL. 


A. 


METHOD 


ACS  answer  sheets  were  collected  from  Reception  Stations,  which  were 
requested  to  send  in  the  sheets  for  the  last  week  of  input  that  took  the 
old  forms  of  the  test,  ACS-3B  and  ACS-4B,  and  the  sheets  for  first  week 
of  input  that  took  the  new  forms  of  the  test,  ACS-5A  and  ACS-6A.  About 
6,000  usable  answer  sheets  were  received  from  seven  installations  which 
sent  in  the  sheets.  The  number  of  answer  sheets  for  each  installation 
is  shown  in  Table  1. 

The  mean  and  standard  deviation  of  each  part  of  each  form  were 
computed  for  each  installation  and  for  the  total  sample.  In  addition, 
the  percentile  ranks  for  each  part  of  each  form  were  computed  for  the 
total  sample. 


Table  1 

NUMBER  CF  ARMY  CLERICAL  SPEED  ANSWER  SHEETS  IN  THE  SAMPIE 


INSTALIATION 


ACS 

Form 

Fort 

Dix 

Fort 

Polk 

Fort 

Ord 

Fort 

Bragg 

Fort 

Knox 

Fort 

Benning 

Fort 

Campbell 

Total 

3B 

39 

107 

174 

86 

503 

468 

208 

1585 

5A 

78 

333 

135 

100 

431 

260 

268 

1605 

LB 

4 4 

185 

67 

116 

390 

380 

202 

1384 

6a 

48 

70 

141 

90 

517 

478 

187 

1531 

RESULTS 

Means  end  standard  deviations  of  the  parts  for  each  installation 
and  for  the  total  sample  are  shown  in  Table  2.  The  corresponding  parts 
of  the  old  and  new  forms  are  shown  in  adjacent  rows;  thus  the  results  for 
3B  and  5A  Number  Reversal  are  shown  together  because  the  items  are 
identical  differing  only  in  the  mechanics  of  responding.  The  means  and 
standard  deviations  are  shown  for  the  raw  scores  rather  than  Army 
Standard  Scores.  The  means  of  the  parts  showed  considerable  variation, 
both  within  and  across  installations.  No  consistent  pattern  of  changes 
in  scores  between  the  old  and  new  forms  emerged  from  the  data  either  in 
means  or  standard  deviations. 
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Table  t> 


PERCENTILE  SCCRES  FCR  THE  ARMY  CLERICAL  SPEED  TEST 


Percentile  Score* 


Raw 

Score 

3B 

Number 

ACS 

5A 

Reversal* 

Form 

4b 

6a 

3B 

Coding* 

ACS  Form 

5A  4B 

6A 

5 

l  - 

2 

1 

2 

2 

1 

2 

3 

2 

10 

5 

3 

4 

3 

3 

3 

6 

3 

15 

8 

6 

8 

7 

8 

9 

12 

9 

20 

19 

14 

18 

16 

21 

23 

25 

20 

25 

35 

29 

38 

37 

43 

46 

47 

42 

50 

60 

54 

65 

64 

66 

67 

71 

63 

35 

80 

76 

83 

82 

83 

82 

85 

81 

4o 

93 

90 

94 

95 

92 

93 

94 

91 

45 

98 

96 

98 

98 

98 

97 

98 

98 

50 

100 

98 

100 

100 

100 

101 

101 

100 

55 

100 

100 

101 

100 

- 

- 

- 

- 

6o 

101 

100 

101 

100 

- 

- 

- 

- 

*The  percentile  scores  are  based  on  the  total  sample. 


* Part  I,  Number  Reversal  has  60  items;  Part  II,  Coding  50  items. 
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The  means  for  the  total  sample  also  showed,  seme  differences ,  but 
again  no  pattern  emerged.  The  mean  for  Number  Reversal  form  5A  was  1.4 
points  higher  than  the  mean  for  form  3B,  but  the  mean  for  6A  was  only 
0.1  point  higher  than  for  4b.  For  the  Coding  part,  where  no  differences 
were  expected,  a  similar  type  of  result  obtained.  The  mean  for  6a  was 
1.2  points  higher  than  for  4B,  but  the  mean  for  5A  was  only  0.2  points 
higher  than  for  3B.  Means  for  the  combination  of  Number  Reversal  and 
Coding  were  as  follows:  3B  -  56.0;  5A  -  57-2;  4b  -  54.6;  and  6a  -  55-9* 
The  corresponding  Army  Standard  Scores  are  115,  116,  113 >  and  115, 
respectively.  The  sample  means  were  relatively  high  because  Category  IV 
personnel,  who  had  taken  the  AQB  at  the  AFEES,  were  not  included.  In 
terms  of  raw  scores,  an  individual  would  appear  to  do  slightly  better 
on  the  revised  forms;  but  in  terms  of  Army  Standard  Scores,  there  is 
virtually  no  difference. 

The  lack  of  a  consistent  pattern  may  have  arisen  in  part  from  the 
short  time  span  in  which  the  answer  sheets  were  collected.  Answer 
sheets  for  each  form  may  have  been  collected  during  only  one  or  two 
sessions.  Since  the  test  is  highly  speeded,  small  Inaccuracies  in 
timing  for  a  session  can  have  a  noticeable  effect  on  the  scores.  In 
addition,  the  quality  of  input  varies  from  day  to  day  and  week  to  week; 
and  this  variation  may  also  have  affected  the  scores.  No  measure  of 
general  ability  was  obtained  on  this  sample  and  therefore  no  statistical 
control  on  quality  of  input  could  be  exercised.  The  small  differences 
for  the  total  sample  assume  even  less  practical  significance  in  light 
of  the  fluctuations  that  can  be  expected  across  time.  As  further  evi¬ 
dence  on  the  comparability  of  the  forms,  percentile  scores  were  computed 
for  each  part  of  each  form  for  the  total  sample  (Table  3)*  The  percen¬ 
tile  scores  also  showed  no  large  consistent  differences  between  the 
forms. 


CONCLUSION 

Because  of  the  similar  score  distributions  found  for  the  old  and 
new  ACS  forms,  no  revision  of  the  norms  is  required  for  the  5A  and  6A 
forms.  The  decision  was  made  to  introduce  the  revised  forms  operation¬ 
ally,  and  to  use  the  norms  that  were  published  for  the  3 B  and  4B  forms,  r 

f 


